Fingerprint-defined segment-based content delivery

ABSTRACT

Digital content, such as video, audio, multimedia, and similar files may be segmented at a determined frame resolution rate and analyzed to determine a fingerprint for each content segment. An identifier that uniquely identifies each content segment may be determined based on the fingerprint of the respective content segment. The identifier may be associated with data relating to the content segment and with one or more identifiers that uniquely identify other content segments of the content. The content segment identifiers may be used to construct a content segment sequencing representation that represents the playback of the content segments in playback order.

BACKGROUND

The present invention relates generally to the field of digital contentfor the delivery of video, audio, and multi-media content, and moreparticularly to innovations for representing and managing digitalcontent.

Current methods for representing and managing digital content, such asdigital video content, stem from early techniques of converting lineartape and film content into digitally storable data. For example, alinear, contiguous stream of captured images may be converted to adigital representation of the images and then stored in a contiguousfile (e.g., a video file) including a series of encoded blocks of data.To playback such a file (e.g., a video file), a rendering device readsthe one or more files of the video file starting at the first encodedblock of data, renders the data into an image, and then repeats theprocess until all of the data for the video has been read and rendered.Thus, playback may be an essentially linear process.

However, a contiguous video file may present challenges relating tovideo processing and editing, transport, and playback. For example,while only a portion of a video file may be edited, the entire videofile is retranscoded after editing, which may increase and time and costof editing the video file. Moreover, the editing process may involveeither altering the original video data or creating one or morealternate versions of the video, which may increase the storagerequired. Further, because the video file is a contiguous data stream,the entire video file may be given to a post production/editingfacility. Thus, restricting access to portions of the video file may bedifficult or impossible.

Additionally, a contiguous video file may provide challenges in digitalviewing systems configured to show content synchronized with coordinatedcontent shown on one or more viewing devices. In particular, theplayback devices may not be contextually aware of the video beingrendered. That is, because the playback device renders the content in anessentially linear process, the content may be rendered without anycontextual information. While some techniques have been utilized toattempt to synchronize coordinated content shown on a second device withcontent shown on a first device, these techniques oftentimes rely ontime metrics that may become corrupted or uninterpretable in somesituations due to skipped, lost, dropped, replayed, paused, or editedportions of the video stream.

It may therefore be desirable to develop a new method for representingdigital content that does not treat digital video as contiguous blocksof data to be read and rendered. Additionally, there is a need for asystem configured to synchronize content with coordinated content usingcontextual information of the video data.

BRIEF DESCRIPTION

The present invention provides novel techniques for content andcoordinated content composition, delivery, and management designed torespond to such needs. In accordance with aspects of the invention, amethod for segmenting digital content includes segmenting digitalcontent at a determined frame resolution rate to produce a plurality ofcontent segments. The method also includes analyzing each of theplurality of content segments to determine a fingerprint for each of thecontent segments. Additionally, the method includes creating a pluralityof identifiers. Each identifier uniquely identifies one content segmentof the plurality of content segments. Further, each identifier iscreated based at least in part upon the fingerprint of the respectivecontent segment.

In accordance with another aspect of the invention, a method of playingback digital content includes determining a first node of a contentsegment sequencing representation. The first node is associated with afirst identifier that uniquely identifies a first content segment of acontent file. The first identifier is determined based at least in partupon a fingerprint of the first content segment. The content segmentsequencing representation defines a playback order of the contentsegments. Additionally, the method includes determining a second node ofthe content segment sequencing representation. The second node isassociated with a second identifier that uniquely identifies a secondcontent segment of the content file. The second identifier is determinedbased at least in part upon a fingerprint of the second content segment.Further, the first and second content segments are created by analyzingthe content file at a determined frame resolution rate.

The invention also provides a system for playing back digital contentincluding a media device configured to receive digital content from oneor more content providers. The media device includes an identifierreader component configured to read one or more identifiers from thedigital content. Each identifier of the one or more identifiers uniquelyidentifies one content segment of a plurality of content segments and isdetermined based at least in part upon a fingerprint of the respectivecontent segment. Additionally, the plurality of content segments iscreated by segmenting a content file into the plurality of contentsegments at a determined frame resolution rate and associating acorresponding identifier of the one or more identifiers to each of theplurality of content segments. Further, the system includes dataprocessing circuitry configured to use the one or more identifiers readby the identifier reader component to construct a content segmentsequencing representation that defines a playback order of the contentsegments.

DRAWINGS

These and other features, aspects, and advantages of the presentinvention will become better understood when the following detaileddescription is read with reference to the accompanying drawings in whichlike characters represent like parts throughout the drawings, wherein:

FIG. 1 is a diagrammatical representation of a content delivery systemincorporating aspects of the present techniques;

FIG. 2 is a diagrammatical representation of a possible scenario inwhich digital content may be segmented and associated with one or moreidentifiers;

FIG. 3 is a diagrammatical representation of a content render graph forcarrying out the present techniques;

FIG. 4 is a further diagrammatical representation of a tablerepresentation for carrying out the present techniques;

FIG. 5 is a diagrammatical representation of a process for the playbackof content;

FIG. 6 is a diagrammatical representation of a process for retrievingcontent from a datastore;

FIG. 7 is a diagrammatical representation of a system for retrievingcontent using a segment lookup service;

FIG. 8 is a diagrammatical representation of a process for the playbackof content;

FIG. 9 is a diagrammatical representation of a content render graph forcarrying out the present techniques;

FIG. 10 is a diagrammatical representation of a content render graph forcarrying out the present techniques;

FIG. 11 is a diagrammatical representation of a content render graph forcarrying out the present techniques;

FIG. 12 is a diagrammatical representation of a content delivery systemfor carrying out the present techniques;

FIG. 13 is a diagrammatical representation of a process for recommendingcontent playback based on user preferences;

FIG. 14 is a diagrammatical representation of a content render graph forcarrying out the present techniques;

FIG. 15 is a diagrammatical representation of a content render graph forcarrying out the present techniques;

FIG. 16 is a diagrammatical representation of a process forsynchronizing content and coordinated content;

FIG. 17 is a diagrammatical representation of a process forsynchronizing content and coordinated content;

FIG. 18 is a diagrammatical representation of a content render graph forsynchronizing content and coordinated content;

FIG. 19 is a diagrammatical representation of a content render graph forsynchronizing content and coordinated content;

FIG. 20 is a diagrammatical representation of a content render graph forediting content;

FIG. 21 is a diagrammatical representation of a content render graph forediting content;

FIG. 22 is a diagrammatical representation of a content render graph formanaging access to content;

FIG. 23 is a diagrammatical representation of a content render graph formanaging access to content; and

FIG. 24 is a diagrammatical representation of a content render graph forediting content.

DETAILED DESCRIPTION

Turning now to the drawings, FIG. 1 represents a content delivery system10 which may manage and provide content and coordinated content that maybe of interest to an audience. In particular, the system 10 may providefingerprint-defined segment-based content, as will be described in moredetail below. In general, the techniques described herein utilizesegments of content, which may be segmented based on a desiredframe/frame-set resolution rate and analyzed to produce a fingerprintfor each content segment, and identifiers associated with thefingerprints of the content segments for dynamic composition of thecontent. For example, the system 10 may be configured to dynamicallyplayback content by retrieving and rendering content segments based on acontent render graph, which is a representation of the content inplayback order.

The system 10 includes a media device 12 that maybe adapted for playingvideo, audio, or multi-media content. In practice, the media device 12may be a television set, a collection of components including atelevision set, a computer with monitor, an audio-only playback system,a hand-held device, a smart phone, or any other media device to whichdigital content is delivered and used by a user or a target audience. Inthe illustrated embodiment, the media device 12 includes a monitor 14for providing still or moving pictures based upon the received content,as well as speakers 16 for providing audio output.

The illustrated media device 12 also includes a data processing systemrepresented generally by reference numeral 18. The data processingsystem 18 may include multiple components as illustrated and describedherein, or in certain embodiments such components may be provided inseparate devices that are used in conjunction with the media device 12,although all these are generally taken into account in the use of theterm media device in the present context. The data processing system 18is designed to receive content 20 from one or more content providers 22(e.g., content distribution systems). Again, this content 20 may includevideo, audio, multi-media, text, any other desired digital content, orany combination thereof. Further, in accordance with the presenttechniques, the content 20 may include fingerprint-defined segmentedcontent. In otherwords, the content 20 may include one or more segmentsof content, determined based upon a particular frame/frameset rateresolution, where each segment is associated with a digital fingerprint.Additionally, in certain embodiments, the content 20 may include one ormore identifiers 24 corresponding to each segment's digital fingerprintthat uniquely identify a respective fingerprint-defined content segmentof the content 20. As will be described in more detail below, theidentifiers 24 may be associated with and/or bundled with metadataassociated with the fingerprint-defined content segments, metadataassociated with the content 20, or any other desired information relatedto the content 20 or the delivery of the content 20. For example, anidentifier 24 may be associated with a content segment and a secondidentifier associated with the next content segment for playback. Theidentifiers 24 may facilitate the management of the content 20 throughproduction, post-production, storage, retrieval, and distribution, aswell as facilitating the dynamic composition of the content 20.

The content providers 22 (e.g., content distribution systems), in turn,may include television broadcast companies, cable providers, satelliteprogramming providers, Internet-based content providers, radio stations,or any other providers of digital content. Moreover, in the illustratedembodiment any one of a range of technologies may be used for deliveringthe content 20 to the media device 12. In the illustrated embodimentthese include cable links 26, such as for cable television, Internetcommunications, and so forth, broadcast technologies as indicated byreference numeral 28, and satellite transmission technology as indicatedby reference numeral 30. Other technologies may, of course, be employed,including cellular technologies, various wireless technologies, and soforth. It should also be noted, that the media device 12 may receive thecontent 20 from a wide range of other components, as indicated byreference numeral 32. These components may include stored contentsources, such as disk readers, solid state memory, cloud computingservices, third-party storage and/or playback systems, and so forth. Ingeneral, all of these sources may be capable of providing the content 20that is played by the media device 12 at a known or unknown time. Thatis, some of the content may be scheduled, such as televisionprogramming, while other content may be viewed at a time that is shiftedfrom a broadcast time slot, or even that corresponds to no particularschedule at all, such as in the case of delayed playback, playback ofstored content, and so forth.

The data processing system 18, as described more fully below, isdesigned to read the identifiers 24 to provide the identifier 24 for arespective content segment and to dynamically playback content byrendering content segments based on a content render graph ofidentifiers indicating the desired order of the content segments forplayback. That is, the system 10 may arrange video segments based uponan order of identifiers stored in the content render graph todynamically construct a video stream. Thus, the system 10 may beconfigured to construct and render a video stream based on contextualinformation (e.g., the fingerprints of the video segments) rather thanrendering a video stream in an essentially linear manner. It should beborne in mind that the system 10 may utilize any suitable techniques forindicating the desired playback order of the content segments and is notlimited to a content render graph. For example, in other embodiments thesystem 10 may be configured to utilize a table, a relational database, alist, a graphical tool, tabulations, an algorithm, and so forth.

Thus, the data processing system 18 will include an identifier reader 34configured to read each identifier 24 and any associated informationbundled with and/or associated with the identifier 24. For example, theidentifier 24 may be bundled/associated with the content segment that ituniquely identifies, metadata about the content segment, metadata aboutthe content 20, and/or one or more identifiers associated with othercontent segments of the content 20. The identifier reader 34 may includeany suitable software or hardware for reading the identifiers 24. Theidentifier reader 34 may also be configured to work in cooperation withprocessing circuitry 36 of the data processing system 18. The processingcircuitry 36 in most cases will include some type of microprocessor,digital signal processor, or the like. The processing circuitry 36performs functions, many of which may be beyond the scope of the presentdescription. The processing circuitry may implement coding and decodingschemes used by the receiver/playback circuitry and so forth. Theprocessing circuitry 36 may include, or separate memory circuitry may beprovided as indicated by reference numeral 38. Moreover, the processingcircuitry 36 may include, or a separate clock may be provided asindicated by reference numeral 40.

The processing circuitry 36 may construct the content render graph (orother content sequencing representation) based at least in part uponinformation received from the identifier reader 34. For example, in someembodiments, the identifiers 24 may be associated with (e.g., in arelational database) and/or bundled with a second identifier associatedwith the next content segment of the content 20. That is, eachidentifier 24 may provide information relating to the next contentsegment for playback. Thus, the processing circuitry may construct acontent segment sequencing representation (e.g., the content rendergraph) such that each identifier 24 is associated with a particularcontent segment and an additional identifier pointing to the nextcontent segment. As will be described in more detail below, theprocessing circuitry 36 may also construct the content render graphusing information received from the identifier reader 34 in combinationwith business logic, metadata (e.g., transaction metadata), and soforth. In some embodiments, the media device 12 may receive the contentrender graph via a distribution stream (e.g., a terrestrial broadcastsignal), which may be decoded by the processing circuitry 36 todetermine the appropriate arrangement of the content segments forplayback. The processing circuitry 36 may then direct receivers/playbackcircuitry 42 using the content render graph, which may play back thecontent segments in the order defined by the content render graph inaccordance with generally known reproduction and playback techniques.

The data processing system 18 may also be designed to operate withexternal devices through interface circuitry 44. Such circuitry may bebased upon any desired technology and protocols, such as Internetprotocols, wireless protocols, telephony protocols, and so forth. Asillustrated in FIG. 1, the interface circuitry 44 may be operativelycoupled to an identifier sequencing datastore 46 that may storeassociated data for the identifiers 24. For example, the identifiersequencing datastore 46 may include a relational database, mass storagefile system, web service, or the like, which may provide informationsuch as the content segment uniquely identified by the identifier 24,one or more possible next identifiers associated with the identifier 24,metadata associated with the content 20, metadata associated with thecontent segment uniquely identified by the identifier 24, and so forth.In some embodiments, the identifiers 24 may not be bundled with a secondidentifier associated with the next content segment for playback. Thus,the processing circuitry 36 may be configured to receive informationfrom the identifier sequencing datastore 46 to determine the nextidentifier associated with the next content segment in order toconstruct the content render graph. Furthermore, as will be described inmore detail below, multiple content segments may be available for aparticular portion of the content stream, such as, for example, standarddefinition content segments, high definition content segments,customer-specific content segments, content segments from differentcontent sources, and so forth. Thus, the processing circuitry 36 may beconfigured to apply business logic or other algorithms to select theappropriate next identifier based on the available next identifiersassociated with the identifier 24 stored in the node sequencingdatastore 46. The identifier sequencing datastore 46 may include anysuitable stored content sources, such as disk readers, solid statememory, cloud computing services, and/or third-party storage, and soforth. Further, in certain embodiments, the identifier sequencingdatastore 46 may be incorporated into the media device 12, rather thanexternal from the media device 12, as illustrated in FIG. 1.

The interface circuitry 44 may also be configured to receive informationfrom one or more video segment datastores 48 that may each store aplurality of video segments. As noted above, multiple content segmentsmay be available for a particular portion of the content stream.Accordingly, the video segment datastores 48 may store multiple versionsof the content segments for the content 20, which may include versionswith different playback resolutions, bit rates, color spaces, and soforth. In some instances (e.g., when the frame/frameset resolution ofprimary content is the same) the multiple versions may have similardigital fingerprints and/or identifiers. As will be described in moredetail below, the processing circuitry 36 may be configured to applybusiness logic or other algorithms to select the appropriate contentsegment from the video segment datastore 48 for playback. Additionally,the processing circuitry 36 may also be configured to apply businesslogic or other algorithms to select the optimal video segment datastore48 to retrieve the content segment. For example, the processingcircuitry 36 may utilize and/or weight factors such as cost,responsiveness, reputation, network latency, the physical proximity ofthe video segment datastores 48 to the media device 12, and so forth.The video segment datastore 48 may include any suitable stored contentsources, such as disk readers, solid state memory, cloud computingservices, and/or third-party storage, and so forth. Further, in certainembodiments, the video segment datastore 48 may be incorporated into themedia device 12, rather than external from the media device 12, asillustrated in FIG. 1.

Coordinated content 50 may also be provided based on the content 20.Such coordinated content 50 will originate in one or more coordinatedcontent providers 52 which, in many practical applications may overlapwith the content providers 22, or these may be separate entities. Incertain presently contemplated embodiments, the coordinated content 50may be intended to directly compliment the content 20, such as in thecase of music, foreign language audio, or other content which isintended directly to be played simultaneously with the content 20. Inother cases, the coordinated content 50 may be somewhat loosely linkedto the content 20, such as to provide details regarding the content 20,additional information regarding plots, characters, actors, and thelike, offers for additional information that may be of interest, sportsscores and statistics, stock prices, product and service offerings, justto mention a few. In other contexts, the coordinated content 50 maysimply be directed to the target audience based upon selection of theprimary content type, as indicated by a geographic location of playback,a demographic drivable from the primary content or other informationstored on the media device 12 or known about the audience, and so forth.

In some embodiments, the coordinated content 50 may be synchronized withthe content 20 on the media device 12. Accordingly, the interfacecircuitry 44 may receive the coordinated content 50 from one or more ofthe coordinated content providers 36. Additionally or alternatively, thecoordinated content 50 may be synchronized with the content 20 anddelivered to a coordinated device 54. The coordinated device 54 may be asmart phone, a hand-held device, a television set, a computer withmonitor, an audio-only playback system, or any other media device towhich digital content is delivered and used by a user or a targetaudience. As will be described in more detail below, the processingcircuitry 36 may control the synchronization of the coordinated content50 by constructing a content segment sequencing representation (e.g.,content render graph) incorporating nodes 56 of the coordinated content50. By rendering content at the content segment level of granularity(e.g., at the frame/frameset resolution), the coordinated content 50 maybe more tightly and dynamically synchronized to the content 20, as willbe discussed in more detail below.

FIG. 2 illustrates an example of a technique for segmenting the content20 and distinctly identifying the content segments based on the digitalfingerprints of the content segments to create the identifiers 24. Whilethe illustrated example relates to video content, it should be notedthat the present techniques may be applied to audio content or any othertype of digital content to be delivered to a user. As illustrated inFIG. 2, the video content 20 may be analyzed at a particularframe/frameset resolution (e.g., a selected frame rate). For example,the video content 20 may be analyzed at individual frames 70 or at a setof contiguous frames 72 (e.g., a frameset). An individual frame 70 or aframeset 72 (e.g., every three frames, as depicted in the currentembodiment) may define a content segment 74. The video content 20 may beanalyzed as the content is being created or at a later time.

The individual frames 70 or the framesets 72 may then be analyzed by afingerprint process 76 to produce and/or identify a fingerprint 78 foreach individual frame 70 or frameset 72. Using the fingerprints of thecontent segments to distinctly identify each content segment may bedesirable because the original content does not need to be modified inorder to produce the fingerprints. That is, the fingerprints mayuniquely identify the content without requiring that the content haveelements or identifying features inserted into the content.Additionally, because the fingerprints do not require the content tohave elements inserted into the content, the fingerprints may uniquelyidentify the content segments across various copies (e.g., versions) ofthe content, such as standard definition versions, high definitionversions, and so forth. That is, the content segments of a standarddefinition version and the content segments of a high definition versionmay have the same fingerprints, if the standard and high definitionversions are segmented at the same frame/frameset resolution rate.Furthermore, because the fingerprints 78 do not require embedding in thevideo content, the fingerprint process 76 may be altered or upgradedwithout needing to recode embedded data in the video content. Thefingerprints 78 may also be resilient to transcoding and transformationsof the video content. Thus, the fingerprints 78 may uniquely identifyprocessed content segments 74. In scenarios in which the fingerprints 78no longer uniquely identify the content segments 74 due to videoprocessing, a new fingerprint may be mapped to the old fingerprint 78because the fingerprints 78 are external to the video content, and thusare not altered by video processing.

The fingerprint process 76 may include any suitable software orfirmware, executed on a computer processor, to create the fingerprints78 or any other unique identifier derived from the individual frames 70or framesets 72 as a whole or from part of the individual frames 70 orframesets 72. Thus, each fingerprint 78 may uniquely identify therespective individual frame 70 or frameset 72 (e.g., the content segment74). It should be noted that in the present context, the features fromwhich the fingerprints 78 are generated are considered unique andpersistent identifiers of the content segments 74. That is, suchfeatures are part and parcel of the content and, when the content ispresent, so long as the same fingerprint generation algorithm isemployed, will result in the same identifying data.

The identifier 24 may then be generated based on the fingerprint 78 ofeach content segment 74. In some embodiments, the identifier 24 may bethe digital fingerprint 78 value directly. In other embodiments, theidentifier 24 may be a single value or a digital object deriveddeterministically from the fingerprint 78 (e.g., via processing logicexecuted on a computer processor). In some embodiments, the identifier24 may function as a lookup key to use with an information system, suchas the identifier sequencing database 46, a relational database, a massstorage file system, a web service, or the like, which uses theidentifier 24 as a key to lookup and retrieve data associated with thekey. For example, a relational database may store data associated withthe identifiers 24 in rows of tables in the relational database. Inparticular, each type of associated data (e.g., the content segment,metadata, the next identifier based on a set of business rules, the nextidentifier based on a different set of business rules, etc.) may bestored as a field in a table row, and the row may be indexed using theidentifier 24 as the key. Thus, searches against the relational databaseusing the identifier 24 as the key may return the rows of dataassociated with the identifier 24. In some embodiments, filteredsearches may be performed by limiting the search to particular types ofdata associated with the identifier 24.

In other embodiments, a mass storage file system includes multiple filedirectories with each file directory named using an identifier 24. Thefile directories may store the data associated with the respectiveidentifier. In some embodiments, each type of associated data may becontained within a separate file of the file directory. The identifier24 may be used to select the file directory matching the identifier 24,and the associated data may then be accessed via the selected filedirectory.

In other embodiments, a web service may be utilized as the informationsystem to store data associated with the identifiers 24. For example,the identifier 24 may be entered in the web service as a parameter in aURL, and the web service may return the data associated with theidentifier 24. To filter or limit the results, a parameter indicatingtypes of data of interest may be included in combination with theidentifier 24 to return only the data of interest.

As illustrated in FIG. 2, the identifier 24 may be associated with thecontent segment 74 that it uniquely identifies. The identifier 24 mayalso be associated with metadata 80, which may be generated by ametadata creation logic component 82. The metadata 80 may be associatedwith the content 20, the content segment 74, and/or business factors,such as a customer account number, customer preferences, cost, and soforth. Additionally, the identifier 24 may be associated with one ormore next identifiers 86, which may each uniquely identify a possiblenext content segment for playback. As will be described in more detailbelow, the processing circuitry 36 may be configured to determine theappropriate next identifier 86 from the one or more possible nextidentifiers 86. The identifier 24 may also be associated with thecontent 20, digital rights data, playback information data, viewerdefined data, and/or identifiers from other content. In someembodiments, the identifier 24 may be associated with an extendedcontent segment beginning with the content segment 74 used to determinethe identifier 24 and extending onwards to include the next contentsegments of the content.

As noted above, the processing circuitry 36 may construct a contentsegment sequencing representation (e.g., a content render graph,sequencing table, or computer-rendered code) that is a representation ofthe content 20 in playback order, which may be used to direct theplayback circuitry 42. In some embodiments, the content sequencingrepresentation may be created in a dynamic manner (e.g., determining anumber of subsequent segments as the content is presented) or statically(e.g., determining the entire sequence of segments prior to presentingthe any of the content). FIG. 3 illustrates an example of a contentrender graph 100 that forms an ordered path expressing the entirecontent to be played back content segment by content segment. Thecontent render graph 100 includes a plurality of nodes 102 and edges104, which connect the nodes 102. Each node represents an identifierthat uniquely identifies a content segment to be played back by theplayback circuitry 42 in the order directed by the content render graph,while each edge represents an identifier that uniquely identifies thenext content segment of the content render graph to be played back. Forexample, as noted above, the content segment represented by the node maybe a video segment, such as one or more video scenes, an audio segment,such as an audio sequence, text, graphics, or any combination thereof.In certain embodiments, a node may represent a content segmentsequencing representation (e.g., a content render graph). That is, anode may represent an ordered sequence of nodes and/or edges. The graph100 may be generated based upon sequencing relationships provided to theprocessing circuitry 36. For example, as discussed above, in someembodiments, each node 102 may be a computer-readable object. The nodes102 may include a reference to a subsequent node 102. This reference maybe used to define the edges 104 pointing the subsequent node 102. Inalternative embodiments, sequencing relationships may be provided by theidentifier sequencing datastore 46.

As illustrated, the content render graph 100 includes a first node 106,which represents a first identifier 108 that uniquely identifies a firstcontent segment 110. The first node 106 may direct the playbackcircuitry 42 using the first identifier 108 to play back the firstcontent segment 110. The content render graph 100 also includes a firstedge 112 that connects the first node 106 to a second node 114. Thefirst edge 112 represents a second identifier 116, which uniquelyidentifies the next content segment for playback (i.e., the secondcontent segment 118). Accordingly, the second node 114 represents thesecond identifier 116, which directs the playback circuitry 42 to playback the second content segment 118. The content render graph 100 mayalso include a third edge 120 representing a third identifier 122, whichuniquely identifies the next content segment for playback (i.e., a thirdcontent segment), and so forth.

In some embodiments, the data processing system 18 may use an identifierof a node to retrieve and return the content segment associated with theidentifier to enable playback. For example, in embodiments in which onlythe content render graph 100 is transmitted to the media device 12, theprocessing circuitry 36 may retrieve and return the desired contentsegments from the video segment datastore 48 based at least in part uponthe identifiers 24 represented by the nodes 102 of the content rendergraph. Further, as will be described in more detail below, theprocessing circuitry 36 may execute various algorithms to determinewhich version of the content segment to deliver to the user, such as astandard definition content segment or a high definition contentsegment, and/or to determine an optimal source for the content segment.That is, while the content provider 22 may provide the content segmentsto the media device 12, the processing circuitry 36 may determinewhether the provided content segments should be rendered by the playbackcircuitry 42 or whether an alternate content segment should be retrievedfrom one of the video segment datastores 48 for playback. Accordingly,in embodiments in which an alternate content segment is desired, theprocessing circuitry 36 and the interface circuitry 44 may coordinatethe retrieval of the desired content segment from one of the one or morevideo segment datastores 48 using the nodes 102 and associatedidentifiers 24 of the content render graph 100.

As noted above, the system 10 may utilize any suitable techniques forindicating the desired playback order of the content segments and is notlimited to the content render graph 100. For example, FIG. 4 illustratesan example of a table 130 that represents the content in playback order.As illustrated, the table 130 may include a first column 132 identifyingthe nodes 102 and a second column 134 identifying the edges 104. Asdescribed above with respect to FIG. 3, each node 102 represents anidentifier that uniquely identifies a content segment to be played backby the playback circuitry 42 in the order directed by the table 130(e.g., starting with the node 102 in the first row of the table 130),while each edge 104 represents an identifier that uniquely identifiesthe next content segment of the table 130 to be played back. Forexample, the table 130 includes a first node 136, which represents afirst identifier that uniquely identifies a first content segment. Thefirst node 136 may direct the playback circuitry 42 using the firstidentifier to play back the first content segment. The table 130 alsoincludes a first edge 138 that is associated with the first node 136 andis stored in the same row of the table 130 as the first node 136. Thefirst edge 138 represents a second identifier, which uniquely identifiesthe next content segment for playback. As illustrated, the value of thefirst edge 138 is used as a second node 140. The second node 140represents the second identifier, which directs the playback circuitry42 to play back the next content segment that is uniquely identified bythe second identifier. The table 130 also includes a third edge 142representing a third identifier, which uniquely identifies the nextcontent segment for playback (i.e., a third content segment), and isused as a third node 144, and so forth.

Turning now to a discussion of how the nodes and edges may be used forplayback, FIG. 5 is a flowchart illustrating a process 150 for playingcontent (e.g., video and/or audio, text, images, etc.) on a client(e.g., the media device 12). A playback device (e.g., the media device12) may read a first node (block 152). For example, the identifierreader 34 may read the first node from the content 20 and/or theprocessing circuitry 36 may read the first node from a content segmentsequencing representation, such as a content render graph, a table, analgorithm, code, and so forth. The media device 12 may retrieve a videosegment, or other digital content segment, using the first node as theidentifier that uniquely identifies the video segment (block 154). Incertain embodiments, the video segment may be transmitted to the mediadevice 12 by the content providers 22. In other embodiments, the mediadevice 12 may be configured to retrieve the video segment from the oneor more video segment datastores 48. In such embodiments, the processingcircuitry 36 may determine the optimal source to retrieve the videosegment (block 156). While the illustrated embodiment shows that theprocessing circuitry 36 may determine the optimal source to retrieve thevideo segment (block 156), it should be noted that any suitableprocessing circuitry or processing device may be configured to determinethe optical source to retrieve the video segment (block 156). Forexample, in certain embodiments, the media device 12 may be configuredto use a subscription service and/or a value-add service that may beconfigured to determine the optimal source to retrieve the video segment(block 156) and may communicate the optimal source to the media device12 and/or may return the video segment from the optimal source to themedia device 12. As will be described in more detail below, to determinethe optimal source from the one or more video segment datastores 48, theprocessing circuitry 36 (or another processing device) may be configuredto consider factors such as cost, responsiveness, reputation, networklatency, or physical proximity. After determining the optimal source,the media device 12 may search the selected video segment datastore 48for the video segment using the identifier 24 as a key (block 158). Themedia device 12 may then retrieve the video segment from the videosegment datastore 48 (block 160) and may determine whether the videosegment was returned to the media device 12 (block 162). If the videosegment was not returned, the process 150 may stop (block 164). If themedia device 12 determines that the video segment was returned, then theplayback circuitry 42 may decode and play the video segment (block 166).It should be borne in mind that the media device 12 may precache one ormore video segments for faster playback.

The media device 12 may then retrieve the next node (e.g., identifier)associated with the next video segment for playback (block 168). Incertain embodiments, the media device 12 may be configured to retrievean edge associated with the first node in a content render graph or in atable. In other embodiments, the media device 12 may look up the edge(e.g., next identifier) for the first node in the identifier sequencingdatastore 46 (block 170). As will be described in more detail below, incertain embodiments, multiple next identifiers or edges may be availablefor a node and may be stored with the node in the identifier sequencingdatastore 46. In such embodiments, the processing circuitry 36 may beconfigured to determine the appropriate next identifier for the nodeusing business logic or other algorithms. The media device 12 mayretrieve the edge from the identifier sequencing datastore 46 (block172) and may determine whether the edge was returned to the media device12 (block 174). If the edge was not returned, the process 150 may stop(block 176). If the media device 12 determines that the edge wasreturned, then the processing circuitry 36 may use the edge as the nextnode value (block 178) and may retrieve the video segment using the nodevalue as the identifier (block 154).

As noted above, the processing circuitry 36 and/or another processingdevice may be configured to determine the optimal source to retrieve thevideo segment. In some embodiments, the processing circuitry 36 maydetermine the optimal source to retrieve the video segment at each videosegment retrieval. Because each video segment 74 has a persistentidentifier 24 determined based on the fingerprint of the video segment,every instance of the same video segment 74 (i.e., the same content),regardless of the encoding, bit rate, resolution, or compression, willhave the same persistent identifier 24. Thus, there may be multipleversions of each video segment 74 across multiple video segmentdatastores 48, which may be suitable for playback by the media device12. This may be desirable, because it may enable the media device 12 toretrieve a higher quality video segment 74 (e.g., a higher resolution)and/or to retrieve a video segment 74 faster (e.g., over a faster, moreresponsive network) and/or at a lower cost (e.g., a less costlynetwork).

FIG. 6 is a flowchart illustrating an example process 180 fordetermining the optimal source to retrieve the video segment. As notedabove, the processing circuitry 36 and/or any other suitable processingcircuitry or processing device may be configured to determine theoptimal source to retrieve the video segment. The process 180 mayinclude detecting available video segment datastores 48 (block 182). Forexample, detecting available video segment datastores 48 may includedetecting one or more video segment datastores 48 stored in the cloudand/or detecting one or more video segment datastores 48 stored on otherdevices that are in proximity to the media device 12. The process 180may also include applying logic parameters (block 184) to select theoptimal video segment datastore from the available video segmentdatastores 48 (block 186). For example, the logic parameters (block 184)may include the responsiveness, reputation, network latency, bandwidth,effective range, and/or physical proximity of the one or more videosegment datastores 48, the cost associated with retrieving the videosegment 74 from the one or more video segment datastores 48, thebandwidth of the media device 12, and so forth. In some embodiments, themedia device 12 may be configured to determine the logic parameters forone or more available video segment datastores. For example, in oneembodiment, the media device 12 may be configured to determine themaximum bandwidth supported by one or more available video segmentdatastores. In some embodiments, the media device 12 may be configuredto determine the optimal network option for the media device 12, such asa local-area network, a Bluetooth network, a Wi-Fi network, and soforth. In certain embodiments, the media device 12 may be configured touse the logic parameters in an algorithm to select the optimal videosegment datastore 48. In one embodiment, the algorithm may weight one ormore of the logic parameters. The media device 12 may then retrieve thevideo segment 74 from the selected optimal video segment datastore 48(block 188).

In certain embodiments, the system 10 may be configured to deliver adifferent (e.g., upgraded) version of one or more video segments 74 tothe user by selecting a different version of the one or more videosegments 74 from the one or more video segment datastores 48. Forexample, as illustrated in FIG. 7, the system 10 may include the mediadevice 12, which may include and/or be operatively coupled to a playbackdevice (e.g., the playback circuitry 42). In some embodiments, the mediadevice 12 may be a TV that is configured to receive content, such as astandard definition version of a video on a VHS tape, broadcast content,and so forth. The media device 12 may also be configured to segment thevideo into a plurality of video segments, analyze the video segments todetermine a fingerprint for each video segment, and determine anidentifier for each video segment based on the fingerprint, as describedabove with respect to FIG. 2. However, it should be noted that in someembodiments, the media device 12 may receive one or more contentsegments, one or more identifiers uniquely identifying the one or morecontent segments, and/or a content segment sequencing representation.The media device 12 may then access a segment lookup service 200 tosearch for and/or retrieve upgraded video segments from the segmentlookup service 200. In certain embodiments, the media device 12 mayaccess the segment lookup service 200 via a network 202 (e.g., theinternet, a local-area network, a Bluetooth network, a Wi-Fi network,etc.). In other embodiments, the segment lookup service 200 may bestored in or otherwise operatively coupled to the media device 12.

The media device 12 may retrieve upgraded video segments (e.g., a highdefinition version or a better quality version) from the segment lookupservice 200 using the determined identifiers for the video segments. Themedia device 12 may be configured to dynamically replace content withupgraded content in real time and/or as an off-line pre-process step. Incertain embodiments, the media device 12 may be configured to determinewhether one or more other versions of the video segments are stored inand/or are available using the segment lookup service 200 (block 204).If the media device 12 determines that no other versions of the videosegments are available, the media device 12 may playback the originalvideo segments (e.g., the video segmented and analyzed by the mediadevice 12) (block 206). However, if the media device 12 determines thatother versions of the video segments are available, the media device 12may then determine whether another available version of one or more ofthe video segments is desirable (block 208). For example, the mediadevice 12 may be configured to determine whether the one or moreavailable versions of the video segments are of better quality and/orresolution than the original video segments. In certain embodiments, themedia device 12 may determine whether the one or more available versionsof the video segments are compatible with the media device 12 forplayback. Further, in some embodiments, the media device 12 maydetermine whether the one or more available versions of the videosegment are geographically compatible (e.g., geo-compatible) with thelocation of the media device 12 and/or a customer location associatedwith a customer account. For example, certain countries may ban orcensor certain videos or video segments. Thus, if a customer provides acensored version of a video to the media device 12, the media device 12may be configured to analyze the available video segments for videosegments that are geographically compatible such that censored portionsof the video are not retrieved. In some embodiments, the media devicemay determine that the available versions are not desirable in responseto a determination that the available versions are not compatible withthe media device 12, are not geographically compatible, and/or are notof better quality/resolution than the original video segments. Forexample, if the content is playing on a standard-definition television,a high-definition version of the content might not be desirable, becausetransmission of the high-definition version may use more transmissionbandwidth, while no benefit from higher definition content is providedby playback on the standard-definition television. If the media device12 determines that the available versions are not desirable, the mediadevice 12 may playback the original video segments (block 206). However,if the media device 12 determines that one or more of the availableversions may be desirable (e.g., compatible with the media device 12 andof better quality/resolution than the original video segments), themedia device 12 may return the new version of the video segments usingthe segment lookup service 200 (block 210). In certain embodiments, themedia device 12 may be configured to select an optimal version from oneor more available and desirable versions of the video segments. Themedia device 12 may then playback the new version of the video segmentsreturned using the segment lookup service 200 (block 212).

In addition to selecting an optimal video segment datastore 48 forretrieval of the video segment 74 and dynamically upgrading the videosegments 74 to a higher quality version, the system 10 may also beconfigured to dynamically compose content by selecting which videosegments 74 to retrieve for playback. In particular, multipleidentifiers or edges may be available for a particular identifier ornode, and the processing circuitry 36 and/or circuitry of the one ormore identifier sequencing datastores 46 may be configured to determinethe appropriate next identifier for the node using business logic orother algorithms. For example, FIG. 8 is a flowchart illustrating anexample process 220 for dynamically composing content by incorporatingtransaction metadata for the content segments 74, the identifiers 24,and/or the nodes 102. The process 220 may be performed in real-time(e.g., at playback time) or may be performed prior to playback. Inparticular, the process 220 may describe an example of the process forlooking up an edge for a given node (block 170), as described in FIG. 5.The process 220 may also include additional steps from the process 150,as described in FIG. 5, such as reading the first node (block 152),retrieving the video segment using the node value as the identifier(block 154), decoding and playing the video segment (block 166), and soforth.

For example, the process 220 may include reading a node (block 222). Themedia device 12 may read the node from the content 20, as describedabove with respect to FIG. 5, from a content segment sequencingrepresentation, and/or from a determined edge value (e.g., using thedetermined edge value as the node value). The process 220 may alsoinclude retrieving an edge associated with the node (block 224). Incertain embodiments, the media device 12 may retrieve the edgeassociated with the node (e.g., identifier) from one of the one or moreidentifier sequencing datastores 46. The node may bundled with orotherwise associated with transaction metadata 226 relating to thecontent segment associated with the node, the user (e.g., a customerID/account number, customer preferences, customer location, and soforth), the media device (e.g., type, model, ID, manufacturer, and soforth), the network provider, the retrieval transaction, and/or anyspecial offer identifiers. For example, the transaction metadata 226relating to the content segment associated with the node may includeinformation such as, the quality of the content segment (e.g., highdefinition, standard definition, etc.), the color depth (e.g., bitdepth) of the content segment, the audio bit depth of the contentsegment, a rating of the content segment (e.g., G, PG, PG-13, R, M,NC-17, etc.), one or more countries that the content segment isgeographically compatible with, the duration of the content segment,information relating to the subject matter and/or storyline of thecontent segment, information identifying the content segment as anadvertisement, information identifying the content segment as includingpremium content, or any other suitable information. Additionally, thetransaction metadata 226 may include information relating to prior nodesof the content segment sequencing representation and/or previously(e.g., recently) played back content segments. For example, the mediadevice 12 may be configured to store information relating to which nodesand/or content segments of the content segment sequencing representationhave been retrieved and/or played back. Further, in certain embodiments,the transaction metadata 226 may include rules and/or comments createdby one or more entities involved during the production and/or editing ofthe content segments, such as a producer or a director.

The process 220 may also include determining whether more than one edgeis available for the node (block 228). Determining whether more than oneedge is available for the node may include searching one or more of theidentifier sequencing datastores 46 using the node to retrieve availableedges associated with the node. If only one edge is available for thenode, the media device 12 may return the edge for the node from theidentifier sequencing datastore (block 230) and may assign the edgevalue as the next node value (block 232). As described above withrespect to FIG. 5, the next node value may then be used to retrieve thecontent segment associated with the node (block 154), and the mediadevice 12 may play back the retrieved content segment (block 166).

However, if the media device 12 and/or circuitry of the one or moreidentifier sequencing datastores 46 determines that more than one edgeis available for the node, the media device 12 and/or circuitry of theidentifier sequencing datastore 46 may input business logic parameters(block 234) to apply business logic using the transaction metadata 226to select an edge to return from the available edges of the identifiersequencing datastore 46 (block 236). Thus, the media device 12 may querythe identifier sequencing datastore 46 using the node, the transactionmetadata 226 associated with the node, and the business logic to returna desired edge. In certain embodiments, the business logic parameters(block 234) may include the transaction metadata 226. By way of example,business logic may be applied using transaction metadata, such as acustomer number and/or an account ID, to select an edge associated witha content segment of higher quality (e.g., higher resolution), an edgeassociated with a content segment with shortened or no advertisements,an edge associated with a content segment of a particular rating (e.g.,G, PG, R, etc.), and so forth. In some embodiments, the media device 12may be configured to consider specifications of the media device 12and/or environmental factors of the viewing area around the media device12 in the determination of which edge to retrieve. For example, themedia device may be configured to receive information from one or moresensors, such as light sensors, motion sensors, and/or microphones, todetermine the environmental factors (e.g., noisy, light, dark, etc.),and the media device 12 may be configured to select an edge based on theenvironmental factors. The one or more sensors may be integrated with oroperatively coupled to the media device 12. In one embodiment, the mediadevice 12 may determine that the viewing area is noisy based on a signalreceived from a microphone and may select an edge associated with anaudio sequence that may optimize the noisy environment. Additionally, inother embodiments, the media device 12 may determine that the mediadevice 12 has a limited color depth and may select an edge associatedwith a content segment having a lower color depth (e.g., 16 bits perpixel instead of 32 bits per pixel). Further, the media device 12 may beconfigured to select certain edges based upon a determination that themedia device 12 is a theater (e.g., cinema) playback devices versus ahome playback device. Accordingly, the media device 12 may then returnthe selected edge for the node from the identifier sequencing datastore(block 230) and may assign the edge value as the next node value (block232).

Accordingly, a plurality of content segment sequencing representationsmay be dynamically constructed using the process 220. FIG. 9 illustratesan example of a content render graph 250 that forms multiple orderedpaths that each expresses a possible playback order of the content to beplayed back content segment by content segment. While the illustratedexample of the content render graph 250 includes multiple ordered pathsof playback, it should be borne in mind that in other embodiments,multiple content render graphs may be constructed to express only onepossible playback order. In embodiments in which the content rendergraph includes multiple ordered paths of playback, the processingcircuitry 36 may be configured to select an ordered path from themultiple ordered paths of playback using the process 220.

As illustrated in FIG. 9, the content render graph 250 includes aplurality of the nodes 102 and the edges 104. As noted above, each noderepresents an identifier that uniquely identifies a content segment tobe played back by the playback circuitry 42 in the order directed by thecontent render graph, while each edge represents an identifier thatuniquely identifies the next content segment of the content render graphto be played back. Additionally, each node 102 include a reference toone or more subsequent nodes 102 and/or may be associated with one ormore subsequent nodes 102 based at least in part upon sequencingrelationships provided by the identifier sequencing datastore 46. Thesereferences and/or sequencing relationships may be used to define theedges 104 pointing to the subsequent nodes 102. For example, theillustrated embodiment of the content render graph 250 includes a firstidentifier 252, which represents a first identifier that uniquelyidentifies a first content segment. The content render graph 250 alsoincludes a first edge 254 that connects the first node 252 to a secondnode 256, which uniquely identifies the next content segment forplayback. As illustrated, the second node 256 is associated withmultiple subsequent nodes (i.e., a third node 258, a fourth node 260, afifth node 262, and a sixth node 264) by multiple edges (i.e., a secondedge 266, a third edge 268, a fourth edge 270, and a fifth edge 272),and the processing circuitry 36 may be configured to determine theappropriate subsequent or next node for playback using the businesslogic and the transaction metadata 226 as described above with respectto FIG. 8.

Dynamically composing content by creating a plurality of content segmentsequencing representations and/or content sequencing representationswith multiple ordered playback paths (e.g., the content render graph250) may be desirable to create a plurality of content versions using aset of content segments, which may allow for more customized versions ofthe content. By way of example, the transaction metadata 226 (e.g.,customer number, account ID, etc.) associated with the second node 256may indicate that the customer meets certain criteria that entitles thecustomer to receive premium and/or upgraded content. In one embodiment,the transaction metadata 226 associated with the second node 256 mayindicate that the customer meets certain criteria to enable the customerto receive content with advertisements removed. For example, the thirdcontent segment 258 may include an advertisement. The processingcircuitry 36 may use the transaction metadata 226 and the second node256 to select the fifth edge 272 that points to the sixth contentsegment 264, thus skipping the advertisement of the third contentsegment 258. In other embodiments, the third content segment 258 mayinclude a standard version of content (e.g., a standard resolutionversion) and the fourth content segment 260 may include an upgradedand/or premium version of content (e.g., a high resolution version, anextended and/or upgraded scene, etc.). In such embodiments, theprocessing circuitry 36 may use the transaction metadata 226 and thesecond node 256 to select the third edge 268 that points to the fourthcontent segment 260 rather than the second edge 266 that points to thethird content segment 258.

In some embodiments, the transaction metadata 226 associated with thesecond node 256 may indicate that the customer meets certain criteriathat entitles the customer to receive a custom version of the content.For example, a media device manufacturer may offer customers customversions of content that are not available to other devices. Thus, themedia device ID, model, and/or type may indicate that the customer mayreceive a custom version of content. For example, the third contentsegment 258 may include a standard content segment of the content andthe fourth content segment 260 may include a custom content segment(e.g., customized based upon the transaction metadata 226) of thecontent. In such embodiments, the processing circuitry 36 may use thetransaction metadata 226 and the second node 256 to select the thirdedge 268 that points to the fourth content segment 260 rather than thesecond edge 266 that points to the third content segment 258.

In certain embodiments, the content may be customized for the customerbased upon customer preferences (e.g., inputted preferences and/orlearned preferences), customer location, and/or customer ID. Forexample, multiple video segments may be generated that each include ascene with a football game, and each version of the video segment mayinclude a different football team. Thus, the content may be customizedto select a video segment including a particular football team basedupon the customer preferences for the particular football team and/orthe geographic location of the customer (e.g., the location of thefootball team). For example, the third content segment 258 may include acontent segment of a football game of the Greenbay Packers versus theDallas Cowboys and the fourth content segment 260 may include a footballgame of the Houston Texans versus the New York Giants. The transactionmetadata 226 may indicate that the customer likes the Houston Texansand/or lives in Houston, Texas. Thus, the processing circuitry 36 mayuse the transaction metadata 226 and the second node 256 to select thethird edge 268 that points to the fourth content segment 260 rather thanthe second edge 266 that points to the third content segment 258.Similarly, content segments including advertisements may be customizedfor the customer based upon transaction metadata 226 relating tocustomer preferences (e.g., inputted preferences and/or learnedpreferences), customer location, and/or customer ID.

Furthermore, content segments including advertisements may be customizedfor the customer based upon transaction metadata 226 relating topreviously played backed content segments of the content segmentsequencing representation. As noted above, the media device 12 may beconfigured to store information relating to which nodes and/or contentsegments have been retrieved and/or played back. The media device 12 mayuse the information as transaction metadata 226 to determine whichcontent segment to retrieve for playback. For example, if the mediadevice 12 determines that three advertisements relating to football havebeen recently played back, the media device 12 may select a contentsegment including an advertisement that is not about football.Additionally, in certain embodiments, the media device 12 may beconfigured to measure an affinity between nodes to select a contentsegment for playback. For example, a content segment sequencingrepresentation may include a node associated with an advertisement for aHonda Odyssey, but the media device 12 may determine that the particularadvertisement for the Honda Odyssey is undesirable (e.g., due to highcost or poor network performance). The media device 12 may then searchthe content segment datastore 48 for one or more nodes with an affinityto the Honda Odyssey node, and may be configured to select the contentsegment with the highest affinity to the Honda Odyssey node, given thatthe content segment is compatible with the media device 12. For example,the media device 12 may be configured to select a node associated with adifferent Honda advertisement to replace the Honda Odysseyadvertisement.

As noted above, the transaction metadata 226 may also include ratingsfor each content segment. For example, the each content segment may beassociated with transaction metadata 226 identifying the respectivecontent segment as G, PG, PG-E, PG-13, R, X, or any other suitablerating. This may be desirable to create multiple versions of the contenthaving different ratings, which may enable the customer to select aversion of the content with a desired rating. For example, thetransaction metadata 226 associated with the customer ID and/or customerpreferences may indicate that the customer is interested in and/or isspecifically requesting only G-rated content. As illustrated in FIG. 10,the first content segment 252, the second content segment 256, and thesixth content segment 264 may each be associated with transactionmetadata 226 identifying the respective content contents as G-ratedcontent segments. Accordingly, to dynamically compose G-rated content,the processing circuitry 36 may be configured to use the transactionmetadata 226 to select the fifth edge 272 that points to the sixthcontent segment 264, thereby skipping the third content segment 258 thatis associated with transaction metadata 226 identifying the thirdcontent segment 258 as a PG-rated content segment. As will beappreciated, in other embodiments the transaction metadata 226 mayindicate that the customer is interested in a different rating. As such,the processing circuitry 36 may be configured to select the second edgethat points to the third content segment 258 that is associated with aPG rating, the third edge 268 that points to the fourth content segment260 that is associated with an R rating, or the fourth edge 270 thatpoints to the fifth content segment that is associated with a PG-13rating based at least in part upon the transaction metadata 226.

Additionally, the content may be customized to omit portions of contentusing the transaction metadata 226. For example, portions of the contentmay be omitted due to time constraints for viewing the content and/orspace constraints of the media device 12. Thus, the system 10 may beconfigured to dynamically reduce a video by omitting one or more contentsegments to fit the viewer's playback window and/or to produce a smallerversion of the video to fit a media device with limited storage. Forexample, a 90 minute movie may be reduced to 60 minutes. Additionallyportions of the content may be omitted, because they are not of interestto the customer. For example, a video may include two storylines (e.g.,storyline A and storyline B). As illustrated in FIG. 11, the first node252 and the fourth node 260 of the content render graph 250 may each beassociated with transaction metadata 226 identifying the contentsegments as relating to storyline A. Additionally, the second node 256and the sixth node 264 may be associated with transaction metadata 226identifying the content segments as relating to both storyline A and B.Further, the third node 258 may be associated with transaction metadata226 identifying the content segment as relating to storyline B. Inembodiments in which the customer is only interested in storyline A, theprocessing circuitry 36 may be configured to use the transactionmetadata 226 to return the third edge 268 that points to the fourthcontent segment 260 that relates to only storyline A. Thus, any contentsegments that only include storyline B are omitted, and content segmentsthat only include storyline A are given priority over content segmentsrelating to both storyline A and B.

As noted above, the transaction metadata 226 may include customerpreferences, which may be inputted preferences or learned preferences.FIG. 12 illustrates an example of the system 10 that may be configuredto use the inputted and/or learned preferences to dynamically composecontent on the media device 12, as well as on other media devices thatare associated with the customer (e.g., via a customer ID or accountnumber). For example, the customer may be configured to inputpreferences relating to types of content to skip, such as contentsegments including violence, language, sexual content, scary situations,etc. In certain embodiments, the customer preferences may be stored in auser preferences datastore 280. The user preferences datastore 280 maybe communicatively coupled to the media device 12 and/or any additionaldevices 282 (e.g., a smartphone, a tablet, an iPad, a computer, and/or aplayback device of a car) via the internet 284. Thus, any additionaldevices 282 that are associated with the customer ID and/or accountnumber of the customer may use the customer ID and/or account number toaccess the customer preferences stored in the user preferences datastore280. As such, content segments (e.g., a second content segment 286 of acontent render graph 288) that include content identified by thecustomer as undesired (e.g., skip points) may be omitted on all mediadevices associated with the customer using the transaction metadata 226.

Additionally or alternatively, the processing circuitry 36 may beconfigured to store information relating to content that is skipped bythe customer during playback to generate learned customer preferences.The learned customer preferences may be associated with the customer IDand/or account number and stored in the user preferences datastore 280to enable the learned customer preferences to be accessed by the mediadevice 12 and the additional devices 282. In certain embodiments, theprocessing circuitry 36 may store the video segments of a video that areskipped, and the additional devices 282 may omit the stored videosegments during playback of the same video using the transactionmetadata 226. For example, a customer 290 may skip a scene of a video(e.g., the second content segment 286 of the content render graph 288)using a remote 292. The processing circuitry 36 may be configured tostore the skipped second content segment in the user preferencesdatastore 280 with the customer ID. Thus, the additional device 282 mayaccess the user preferences datastore 280 using the customer ID and mayapply the transaction metadata 226 (e.g., the learned customerpreferences for the skipped content segment) to omit the second contentsegment 286 of the content render graph 288.

The processing circuitry 36 may also automatically learn customerpreferences. In particular, the processing circuitry 36 mayautomatically learn which content segments the customer may likely wantto skip, rather than only skipping content segments which have beenskipped by the customer. This may be desirable to recommend skip pointsand/or versions of content with scenes omitted to the customer that maybe of interest to the customer. For example, the customer may select amovie to watch on the media device 12, such as an On Demand movie, apay-per-view movie, or a recorded movie, and the media device 12 mayrecommend omitting one or more content segments of the movie prior toplayback and/or may automatically omit one or more content segments ofthe movie during playback based upon the learned customer preferences.Additionally, in certain embodiments, the inputted and/or learnedcustomer preferences may be stored in the user preference datastore 280,which may be accessed by media devices of other customers to recommendskip points and/or versions of content with scenes omitted to the othercustomers. For example, FIG. 13 illustrates a flow chart of a process294 for using learned customer preferences to suggest content sequencingrepresentations for playback. The process 294 may include determiningpatterns associated with content segment selection (block 296). Incertain embodiments, determining patterns associated with contentsegment selection may include determining patterns relating to skippedor omitted content segments. For example, the processing circuitry 36may be configured to categorize the content that is skipped by the userinto one or more types of content, such as violence, language, sexualcontent, scary situations, etc., to determine patterns associated withthe skipped content.

The process 290 may also include suggesting content segment selections(e.g., skip points) based upon the determined patterns, business logic,and/or user demographics (block 298). For example, the system 10 (e.g.,the media device, the user preferences datastore 280, and/or theadditional devices 282) may be configured to collect demographics datafor one or more customers, such as age, gender, geographic location,number and/or ages of possible children, and so forth. A media deviceassociated with a customer ID may determine demographic information forthe customer associated with the customer ID, and may search the userpreferences datastore 280 for content segment patterns of customershaving similar demographic information. The media device may thenretrieve the content segment patterns of one or more customers havingsimilar demographic information to the customer of interest or mayretrieve the content segment patterns of the customer having the closestdemographic information to the customer of interest, and the mediadevice may suggest the returned content segments patterns of thecustomer. By way of example, the user preferences datastore 280 maystore a content segment pattern of skipping content segments that areidentified as R-rated content and may associate the content segmentpattern with demographics data identifying the customer as a parent of a12 year old child. The stored content segment pattern may be suggestedto other parents of similarly aged children (e.g., 10-15 years old).

Accordingly, a plurality of content versions may be created and may becustomized for the customer based on transaction metadata 226 andbusiness logic parameters. In some embodiments, the media device 12 maybe configured to provide an indication to the customer that the customerwatched a unique or customized version of content. For example, themedia device 12 may provide an indication (e.g., a textual message) atthe end of the playback of the content. Additionally or alternatively,the media device 12 may be configured to store information relating tocustomized versions of content watched by the customer. For example, themedia device 12 may be configured to create and store a log of allcustomized versions of content watched by the user. In some embodiments,the log may be stored on the memory of the media device. In otherembodiments, the log may be associated with a customer account number,so the customer may view the log from a different device, such asviewing the log on a computer using the internet. Further, in someembodiments, the media device 12 may be configured to receiveinformation relating to customized versions of content watched by otherusers (e.g., friends or family of the customer) and may provide theinformation to the customer. For example, if the customer watched acustom version of a movie, the media device 12 may provide a comparisonof custom versions of the movie watched by other customers to the customversion of the movie watched by the customer. By way of example, thecomparison may include a list of scenes skipped or substituted (e.g.,for a custom content segment).

As noted above, the content segments sequencing representations may alsobe used to increase access control over the content. For example, theedges 104 and/or the transaction metadata 226 associated with the nodes102 may include time and/or business rules, which may be used to limitaccess to the content segments to prohibit the playback of such contentsegments. In certain embodiments, the transaction metadata 226 mayinclude time and/or business rules created by one or more entitiesinvolved during the production and/or editing of the content segments,such as a producer or a director. In one example, the time and/orbusiness rules may prohibit the edge 104 from being available forplayback after the number of times that the content segment 74identified by the edge 104 has been played back exceeds a predeterminedmaximum number of playbacks for the content segment 74. Additionally,the time and/or business rules may include rules that prohibit the edge104 from being available for playback before a certain date and/or timeor after a certain date and/or time. In one use case, this thresholdcount functionality may be beneficial in ad-scheduling based uponpromised impressions. For example, a first advertisement may be offereduntil a particular number of impressions is reached. After the countthreshold is reached, the advertisement may be switched. As illustratedin FIG. 14, a content render graph 300 may include a first node 302connected to a second node 304 by a first edge 306. The first edge 306includes a time rule 308 that prohibits playback of the second node 304after a predetermined date (e.g., Jan. 1, 2014). However, it should benoted that in other embodiments, the second node 304 and/or thetransaction metadata 226 may include the time rule. Accordingly, afterthe predetermined date, the content render graph 300 may prohibitplayback of the second node 304 and, in some embodiments, may select analternate node 309 for playback.

In other embodiments, the time and business rules may prohibit retrievalof the nodes 102 and/or edges 104 from the one or more identifiersequencing datastores 46. For example, as illustrated in FIG. 15, acontent render graph 310 may include a first node 312 connected to avariable edge 314, as indicated by query block 316. In particular, thefirst node 312 (e.g., the identifier associated with the node 312) andthe transaction metadata 226 (e.g., time and date) may be used to searchthe identifier sequencing datastores 46 for the appropriate edge 314. Asillustrated in the identifier sequencing datastore 46, the first node312 is associated with two possible edges 314, which are each associatedwith a different next node, and thus a different next content segment.The first possible edge 316 is also associated with and/or includes arule that indicates that the edge 316 is not available after apredetermined date. Thus, if the identifier sequencing datastore 46determines that the current date is after the predetermined date, theidentifier sequencing datastore 46 may prohibit the retrieval of thefirst possible edge 316 by the media device 12. As illustrated, thesecond possible edge 318 does not include a business rule. Thus, thesecond edge 318 may be retrieved by the media device 12 for the contentrender graph 310. Additionally, in certain embodiments, the media device12 may be configured to inform the user if the edge returned from theidentifier sequencing datastore 46 is not the edge requested. Forexample, the media device 12 may be configured to provide a indication(e.g., a first indicator light on the media device 12, a textualmessage, etc.) to inform the user that a different edge has beenreturned due to time and/or business rules or for the user's benefit(e.g., upgraded content and/or content retrieved from an optimalsource). Additionally, in some embodiments, the media device 12 may alsoprovide an indication (e.g., a second indicator light on the mediadevice 12, a textual message, etc.) to inform the user that the edgereturned is not the edge requested due to tampering with the system 10.

As described in detail above, the present techniques utilizefingerprint-defined segment-based content and identifiers associatedwith the fingerprints of the content segments for dynamic composition ofthe content. For example, rather than playing back linear, contiguouscontent (e.g., a contiguous video file), the system 10 may dynamicallycompose content using content segment sequencing representations thatdefine a desired playback order of content segments. The presenttechniques may increase storage efficiency. In particular, becausecontent may be dynamically composed by constructing different contentsegment sequencing representations, a plurality of content versions maybe created using a set of content segments. Thus, the different contentversions may not need to be stored, but may be composed prior to orduring playback. Furthermore, the content segments may be stored in aplurality of content segment datastores, which may be accessed by themedia device (e.g., via the internet), which may further reduce thestorage required by the media device.

Moreover, the present techniques may increase the degree ofcustomization associated with the content. That is, transaction metadatarelating to the content segment associated with the node, the user(e.g., a customer ID/account number, customer preferences, customerlocation, and so forth), the media device (e.g., type, model, ID,manufacturer, and so forth), the network provider, the retrievaltransaction, and/or any special offer identifiers may be applied tobusiness logic to dynamically select a content segment for playback. Forexample, the content may be customized to include content of interest tothe user, to omit content that is not of interest to the user, toshorten the playback time to fit a user's playback window, and so forth.This customization may be completed using any of the functionalitydescribed herein, either alone or in combination with otherfunctionality described herein. For example, in an effort to reducestorage size and/or play time of content, the dynamic plot selection ofFIG. 11 may be implemented alone or in combination with the sceneskipping functionalities discussed in FIGS. 12 and 13.

As noted above, the system 10 may be configured to playback content 20and coordinated content 50. As will be described in more detail below,the system 10 may synchronize the playback of the content 20 and thecoordinated content 50 using one or more content segment sequencingrepresentations including nodes 102 and edges 104 for both the content20 and the coordinated content 50. By rendering content at the contentsegment level of granularity (e.g., at the frame/frameset resolution),the coordinated content may be more tightly and dynamically synchronizedto the content. Additionally, the system 10 may be configured tosynchronize playback of the content 20 and the coordinated content 50 onthe media device 12 and/or may synchronize playback of the content 20 onthe media device 12 with the playback of the coordinated content 50 onone or more coordinated devices 54.

FIG. 16 illustrates an example process 330 for playing back content andcoordinated content. The process 330 includes obtaining content 20(block 332). As described in detail above, the content 20 may beobtained from one or more content providers 22. Additionally, thecontent 20 may include the content segments 74, one or more identifiers24 that each uniquely identifies a respective content segment 74,transaction metadata 226, and/or a content segments sequencingrepresentation that defines the playback order of the content 20 contentsegment by content segment. The process 330 also includes obtainingcoordinated content 50 (block 334). In some embodiments, the coordinatedcontent 50 may be supplemental (e.g., secondary) content. As notedabove, the content 50 may be obtained from one or more content providers52. It should be noted that the content 20 and the coordinated content50 may be obtained from the same type or different types of contentproviders. For example, in some embodiments, the content 20 may beobtained from a cable provider and the coordinated content 50 may beobtained from an Internet-based provider. Additionally, the coordinatedcontent 50 may include content segments 74, one or more identifiers 24that each uniquely identifies a respective content segment 74,transaction metadata 226, and/or a content segments sequencingrepresentation that defines the playback order of the content 20 contentsegment by content segment. As noted above, the coordinated content 50may be intended to directly compliment the content 20, such as in thecase of music, foreign language audio, or other content which isintended directly to be played simultaneously with the content 20. Inother cases the coordinated content 50 may be somewhat loosely linked tothe content 20, such as to provide details regarding the content 20,additional information regarding plots, characters, actors, and thelike, offers for additional information that may be of interest, sportsscores and statistics, stock prices, and/or product and serviceofferings. Further, in some embodiments, the supplemental content 50 mayinclude advertisements and/or announcements, which may relate to thecontent 20 or may relate to other content that may be of interest to thecustomer. In other contexts, the coordinated content 50 may simply bedirected to the target audience based upon selection of the contenttype, as indicated by a geographic location of playback, a demographicdrivable from the primary content or other information stored on themedia device 12 or known about the audience, and so forth.

The process 330 also includes playing back the content and thecoordinated content in sync (block 336). Playing back the content andthe coordinated content in sync may include dynamically constructing acontent segment sequencing representation including nodes 102 and edges104 for both the content 20 and coordinated content 50. In particular,the edges 104 of the content segment sequencing representation mayenable playback of the content and coordinated content with contextualinformation (e.g., defining the playback order of the content andcoordinated content in relation to each other).

FIG. 17 illustrates a more detailed process 340 for playing back thecontent and the coordinated content in sync (block 336). The process 340may include obtaining content (block 332) and obtaining coordinatedcontent (block 334), as described above with respect to FIG. 16. Theprocess 340 also includes reading a first node (block 152), as describedabove with respect to FIG. 5. Moreover, it should be noted that thesteps for playing back content 20 may include one or more additionalsteps of the process 150 of FIG. 5. Further, it should be noted that thesteps relating to the playback of the coordinated content 50 may beperformed by the media device 12, the coordinated device 54, or anyother suitable device.

In addition to providing information relating to the playback of thecontent, the first node may also provide information relating to theplayback of coordinated content. Accordingly, the first node (e.g., theidentifier associated with the first node) may be used to retrieve acoordinated edge for the node (block 342). In certain embodiments, themedia device 12 and/or the coordinated device 54 may be configured toretrieve a coordinated edge associated with the first node in a contentrender graph or in a table, which may be broadcasted to the media device12 and/or the coordinated device 54. In other embodiments, the process340 may include looking up the coordinated edge using the node from asequencing service (e.g., the identifier sequencing datastore 46) (block344). It should be noted that transaction metadata 226 for the content20 and/or the coordinated content 50 may be used in combination withbusiness logic parameters, as described above with respect to FIG. 8, toselect an appropriate coordinated edge from a plurality of availablecoordinated edges associated with the node. The media device 12 and/orthe coordinated device 54 may then retrieve the coordinated edge value(block 346) and determine whether the coordinated edge value wasreturned (block 348). If the coordinated edge value was not returned,the process 340 may stop (block 350).

If the media device 12 and/or the coordinated device 54 determines thatthe coordinated edge was returned, then the coordinated edge value maybe used as the coordinated node for the content segment sequencingrepresentation (block 352). The process 340 may then include retrievingthe coordinated content segment using the coordinated node as theidentifier that uniquely identifies the coordinated content segment(block 354). For example, the media device 12 and/or the coordinateddevice 54 may search a content segment datastore (e.g., a coordinatedcontent segment datastore or the video segment datastore 48) using thenode (e.g., identifier) as a key (block 356). The media device 12 and/orthe coordinated device 54 may then retrieve the coordinated contentsegment from the content segment datastore (block 358) and may determinewhether the coordinated content segment was returned to the media device12 and/or the coordinated device 54 (block 360). If the coordinatedcontent segment was not returned, the process 340 may stop (block 362).If the media device 12 and/or the coordinated device 54 determines thatthe coordinated content segment was returned, then the media device 12and/or the coordinated device 54 may decode and play the coordinatedcontent segment (block 364).

The media device 12 and/or the coordinated device 54 may then retrievethe next node (e.g., identifier) associated with the next coordinatedcontent segment for playback (block 366). For example, the media device12 and/or the coordinated device 54 may look up the coordinated edge forthe node from the identifier sequencing datastore (block 368) or mayretrieve the coordinated edge from a constructed content segmentsequencing representation. The media device 12 and/or the coordinateddevice 54 may retrieve the edge value (block 370) and may use the edgevalue as the next node value (block 352).

Accordingly, a plurality of content segment sequencing representationsmay be dynamically constructed using the process 340, which may becombined with the process 150 of FIG. 5 and the process 220 of FIG. 8.For example, FIG. 18 illustrates an example of a content render graph380 that forms an ordered path expressing the playback of content 20 andcoordinated content 50. Additionally, FIG. 18 illustrates an example ofthe content 20 and coordinated content 50 as they are played back ateach node 102 of the content render graph 380. As illustrated, theprimary content 20 and the coordinated content 50 are both played backon the same device (e.g., the media device 12). To direct the mediadevice 12 that both the content 20 and the coordinated content 50 shouldbe played back on the media device 12, the transaction metadata 226 forthe content 20 and/or the coordinated content 50 may include informationrelating to the desired playback device for the coordinated content 50.

As illustrated, the content render graph 380 begins with a first node382 that uniquely identifies a content segment for playback. The firstnode 382 may be associated with a first content edge 384 that identifiesthe next node 386. Additionally, the first node 382 may be associatedwith a first coordinated edge 388 that identifies a first coordinatednode 390, which may uniquely identify a coordinated content segment forplayback. Playback of the content segment associated with the node 386and playback of the coordinated content segment associated with thecoordinated node 390 may be synchronized, because the first node 382 isconnected to the two edges 384 and 388, and thus, directs thesynchronized playback of the content segments associated with the node386 and the coordinated node 390.

The content render graph 380 may also include a third node 392 and asecond coordinated node 394. Playback of the nodes may be directed bythe edges preceding the respective nodes, as described above withrespect to FIG. 9. Additionally, the content render graph 380 mayinclude a first synchronizing edge 396 connecting the third node 392 andthe second coordinated node 394. The first synchronizing edge 396 maydirect the media device 12 to synchronize the playback of the contentsegments associated with the third node 392 and the second coordinatednode 394. Additionally, the content render graph 380 may include asecond synchronizing edge 398 connecting the second coordinated node 394to a fourth node 400. The second synchronizing edge 398 may include arule and/or transaction metadata 226 that may direct the media device 12to synchronize the playback of the content segment associated with thesecond coordinated node 394 with the content segment associated with thefourth node 400 or may direct the media device 12 to terminate theplayback of the content segment associated with the second coordinatednode 394 prior to playback of the content segment associated with thefourth node 400.

As noted above, playback of the content 20 and coordinated content 50may also be synchronized on separate devices. For example, FIG. 19illustrates an example of a content render graph 410 that forms anordered path expressing the playback of content 20 and coordinatedcontent 50 on separate devices. As noted above, rules and/or transactionmetadata 226 associated with the nodes 102 and/or the edges 104 mayindicate that the content 20 and the coordinated content 50 should beplayed back and synchronized on separate devices. As illustrated, thecontent 20 may be played back on one device (e.g., the media device) andthe coordinated content 50 may be played back on a different device(e.g., the coordinated device 54). The nodes 102 and the edges 104 ofthe content render graph 410 may function similar to that of the contentrender graph 380, as described above with respect to FIG. 18.

In some embodiments in which the playback of the content 20 and thecoordinated content 50 are synchronized on separate devices (e.g., themedia device 12 and the coordinated device 54), the content render graph410 may be transmitted to the coordinated device 54 to direct theplayback of the coordinated content 50 by the coordinated device 54. Thecontent render graph 410 may be dynamically constructed by the mediadevice 12 or may be transmitted to the media device by one of thecontent providers 22. In certain embodiments, the media device 12 mayreceive a content render graph, or other type of content segmentsequencing representation, from the content providers 22, and maydetermine which nodes of the content render graph to playback on themedia device and which nodes to transmit to the coordinated device 54for playback. That is, the media device 12 may be configured to analyzethe content render graph (e.g., using transaction metadata 226 and/orbusiness logic) to select a suitable playback device for each node ofthe content render graph.

As noted above, the present techniques utilize fingerprint-definedsegment-based content and identifiers associated with the fingerprintsof the content segments for dynamic composition and synchronization ofcontent and coordinated content. Additionally, segmenting the contentmay provide increased access control over the content. For example,selected content segments may be transmitted to anediting/post-production company for editing, rather than a complete,contiguous content file. In other embodiments, an encrypted version ofthe complete, contiguous content file may be transmitted to anediting/post-production company along with a key management scheme,which may enable the editing/post-production company to only access thecontent segments to be edited.

Furthermore, segmenting the content may be desirable during the editingprocess as a master content version may remain unedited, while multipleversions of the content may be created by constructing different contentsegment sequencing representations. For example, FIG. 20 illustrates anexample of a content render graph 450 for editing content. The contentrender graph 450 may be based upon and altered from a master contentversion 452 to create edited content render graphs and thus, editedcontent. For example, the content render graph 450 may be edited fromthe master content version 452 to delete one or more content segments.In particular, as illustrated by a content render graph version 454, anew edge 456 may be added in order to skip (e.g., omit) a node 458. Insome embodiments, a pointer modification component 460 may be used toalter edit the content render graph 450. For example, a user may inputdesired edits to the pointer modification component 460, which mayimplement software to create a new version of the content render graphbased on the inputted edits by adding and deleting edges. In otherembodiments, the content render graph 450 may be edited to rearrangenodes, as illustrated in a content render graph version 462.Additionally, in some embodiments new nodes 464 associated with newcontent segments may be added to create a content render graph version466 with an additional node 468. Accordingly, the pointer modificationcomponent 460 may direct the insertion of the node 468 into the contentrender graph 466 by addition and deleting edges. In some embodiments,the new nodes 464 may be associated with different versions

Additionally, the pointer modification component 460 may include an undofunction to revert the content render graph to a previous content rendergraph version, which may be the most recent content render graphversion, the original content render graph version, or an intermediatecontent render graph version. Furthermore, the pointer modificationcomponent 460 may be configured to record and store all of themodifications made to the content render graph.

In some embodiments, the pointer modification component 460 may beconfigured to use business logic and/or rules to determine the edits forthe content render graph 450. Additionally, the pointer modificationcomponent 460 may be configured to add business logic, business rules,and/or metadata to the nodes and/or edges of the content render graph450. In one embodiment, a producer, director, or other individual orentity involved in the production and/or editing of the content may addbusiness logic, business rules, and/or metadata to the content rendergraph 450 using the pointer modification component 460. For example, thepointer modification component 460 may be configured to add metadataabout the content segment identified by the node, such as metadataidentifying the quality of the content segment (e.g., high definition,standard definition, etc.), the color depth (e.g., bit depth) of thecontent segment, the audio bit depth of the content segment, a rating ofthe content segment (e.g., G, PG, PG-13, R, M, NC-17, etc.), one or morecountries that the content segment is geographically compatible with,the duration of the content segment, information relating to the subjectmatter and/or storyline of the content segment, information identifyingthe content segment as an advertisement, information identifying thecontent segment as including premium content, or any other suitableinformation. This information may be desirable to facilitate the dynamicplayback of content by the media device 12.

The master content version 452 may also be edited to create additionalcontent relating to the content, such as content summaries, highlights,trailers, videos including commentary, and so forth. This may bedesirable, because the content does not need to be re-rendered in orderto create new content. Rather, new content segment sequencingrepresentations may be created to create the new content. This maydecrease the storage space required and also may decrease the copying,transmission, and/or movement of the content during production, becauseonly the changes to the content segment sequencing representation may bestored, transmitted, and/or shared. For example, FIG. 21 illustrates anexample content render graph 480, which may be created using the mastercontent version 452, which may direct the playback of the contentsegments to create a trailer. As illustrated, a new node 482 associatedwith a content segment including a title scene may be added using thepointer modification component 460. Additionally, a second new node 484may be added that is associated with a content segment of a sceneincluding a release date for the content (e.g., a movie release date).Further, any number of new nodes may be added to the content rendergraph 480, such as nodes associated with content segments that functionto transition between scenes (e.g., a black screen), nodes associatedwith content segments including a cast run (e.g., the names of thedirector, producer, actors, etc.), nodes associated with contentsegments including a logo or graphic of a production company ordistributor, etc. The pointer modification component 460 may beconfigured to insert the new nodes 482 and 484 into the content rendergraph 480 based up parameters inputted by the user. Additionally, asdescribed above, the pointer modification component 460 may beconfigured to add and/or delete edges of the content render graph 480 torearrange nodes of the content render graph 480 and to omit nodes of thecontent render graph 480 (e.g., to shorten the movie to a suitablelength for a trailer). Further, in certain embodiments, the pointermodification component 460 may be configured to merge or synchronize oneor more coordinated content render graphs 486 with the content rendergraph 480 and/or the master version of the content render graph 452. Forexample, synchronizing the coordinated content render graph 486 with thecontent render graph 480 may be desirable to overlay audio content, orany other desired digital content, with the content segments of thecontent render graph 480. In one embodiment, the coordinated contentrender graph 486 may include content segments including a voice-overnarration and/or music (e.g., a portion of a score).

As noted above, selected content segments may be transmitted to anediting/post-production company for editing, rather than the complete,master content file. This may be desirable to decrease the amount ofcontent that is transmitted and to increase the access control of thecontent. For example, as illustrated in FIG. 22, a first set of contentsegments 490 of a master content file 492 may be transmitted (e.g., bytransmit component 494) to a first post-production system 496. It shouldbe noted that any number of content segments of the master content file492 may be transmitted to a post-production system. Furthermore, whilethe illustrated first set of content segments 490 includes sequentialcontent segments, in other embodiments, non-sequential content segmentsmay also be transmitted by the transmit component 494. Additionally, asecond set of content segments 498 may be transmitted (e.g., by thetransmit component 494 or another transmit component) to a secondpost-production system 500.

In other embodiments, an encrypted version of the master content file492 may be transmitted to an editing/post-production company along witha key management scheme, which may enable the editing/post-productioncompany to only access the content segments to be edited (e.g., thesegments they have decryption keys for). For example, as illustrated inFIG. 23, the master content file 492 includes encrypted content segments508, which is graphically represented by the lock symbol. Theillustrated embodiment of the master content file 492 includes twolevels of encryption. For example, the content segments 508 may beencrypted using a first DRM encryption scheme (e.g., a first set of DRMrights) and/or a second DRM encryption scheme (e.g., a second set of DRMrights). As illustrated, the content segments 508 including a locklabeled “1” may be encrypted using the first DRM encryption scheme, thecontent segments including a lock labeled “2” may be encrypted using thesecond DRM encryption scheme, and the content segments including a locklabeled “1/2” may be encrypted using both DRM encryption schemes. Thefirst post-production system 496 may include a first key managementscheme 510, which may be configured to decode the first DRM encryptionscheme. The second post-production system 500 may include a second keymanagement scheme 512, which may be configured to decode the second DRMencryption scheme. Accordingly, each of the post-production systems 496and 500 can only access the segments that their keys 510 and 512,respectively, will decrypt.

Alternatively, the master content file 492 may be transmitted to thepost-production systems 496 and 500 along with an encrypted contentrender graph. That is, rather than encrypting the content segments ofthe master content file, the nodes and/or edges of the content rendergraph may be encrypted. Thus, the key management schemes provided to thepost-production companies may be configured to decode the nodes of thecontent render graph to access the content segments associated with therespective nodes. Additionally, it should be noted that the presenttechniques for encrypting content segments and/or nodes may be extendedto other scenarios and are not restricted to use with post-productioncompanies. For example, an individual may apply the encryptiontechniques to a personal content file (e.g., a movie owned by theindividual) to prevent copying of the content file and/or to preventaccess to particular content segments of the content file.

In some embodiments, the editing/post-production company (e.g., thefirst post-production system 496 and/or the second post-productionsystem 500) may alter the content render graph transmitted to theediting/post-production company during the editing process. Further, insome embodiments, the editing process may change the fingerprint of oneor more content segments in the content render graph. For example,adding visual effects to a content segment may alter the fingerprint ofthe content segment. Accordingly, the post-production systems 496 and500 may be configured to create new nodes based at least in part uponthe new fingerprints of the content segments and to adjust the contentrender graph based at least in part upon the new nodes. In someembodiments, the post-production systems 496 and 500 may include afingerprint algorithm, such as the fingerprint algorithm 76 of FIG. 2,to analyze the content segments to determine the fingerprints. In otherembodiments, the post-production systems 496 and 500 may be configuredto use a subscription service or another processing device to determinethe new fingerprints. For example, as illustrated in FIG. 24, the firstpost-production system 496 may receive a first content render graph 510,and the second post-production system 500 may receive a second contentrender graph 512. The first and second content render graphs 510 and 512may be transmitted to the respective post-production systems using thetechniques described above with respect to FIGS. 22 and 23. Asillustrated, the first content render graph 510 includes two nodes (nodeA and node B) and includes a reference node 514 (node C). The referencenode 514 (e.g., link point) may reference a node of the second contentrender graph 512 to facilitate the merging of the first and secondcontent render graphs 510 and 512 after the editing process. Similarly,the second content render graph 512 includes two nodes (node C and nodeD) and includes a reference node 516 (node B), which may reference anode of the second content render graph 512.

As noted above, the post-production systems 496 and 500 may edit thecontent, which may alter the fingerprint of one or more content segmentsof the content render graphs, and may generate new nodes based on thealtered fingerprints. For example, the post-production system 496 may beconfigured to generate new nodes 518 (node B1, node B2, node B3, andnode B4), which may replace one or more nodes of the content rendergraph 510. The post-production system 496 may also create a new contentrender graph 520 incorporating the new nodes 518. Similarly, thepost-production system 500 may generate new nodes 522 (node C1, node C2,and node C3), which may replace one or more nodes of the content rendergraph 512. Additionally, the post-production system 496 may create a newcontent render graph 524 incorporating the new nodes 522.

In some embodiments, after the post-production systems 496 and 500 haveedited the content, the new content render graphs 520 and 524 may bemerged (e.g., compiled) into a merged content render graph 526. Anysuitable processing circuitry or processing device may be used toreceive and merge the content render graphs 520 and 524 using anysuitable algorithm. For example, in some embodiments, a productionsystem may be configured to receive and merge the content render graphs520 and 524. Additionally, the system may be configured to use thereference nodes 514 and 516 to merge the content render graphs 520 and524. In some embodiments, the post-production systems 496 and 500 may beconfigured to maintain a list of edits (e.g., modifications) to therespective content render graph, which may facilitate the merging of thecontent render graphs. Additionally or alternatively, a productionsystem may record contextual information relating to the position of thecontent render graphs 510 and 512 relative to the master content rendergraph, which may facilitate the merging of the content render graphs.For example, the production system may record the contextual informationat the point of transmission (e.g., when the content render graph 510 istransmitted to the first post-production system 496) and/or at the pointof return (e.g., when the content render graph 510 is transmitted backto the production system).

As described above, the present techniques utilize fingerprint-definedsegment-based content and identifiers associated with the fingerprintsof the content segments to edit the content and to control access to thecontent. For example, multiple edited versions of the content and/oradditional content (e.g., trailers, highlights, content summaries) maybe created by constructing different content segment sequencingrepresentations, while a master content version may remain unmodified.This may increase storage efficiency of the system. Additionally,segmenting the content may provide increased access control over thecontent by enabling only selected content segments to be accessed byparticular entities.

While only certain features of the invention have been illustrated anddescribed herein, many modifications and changes will occur to thoseskilled in the art. It is, therefore, to be understood that the appendedclaims are intended to cover all such modifications and changes as fallwithin the true spirit of the invention.

1. A method for segmenting digital content, comprising: segmentingdigital content at a determined frame resolution rate to produce aplurality of content segments; analyzing each of the plurality ofcontent segments to determine a fingerprint for each content segment;and creating a plurality of identifiers, wherein each identifieruniquely identifies one content segment of the plurality of contentsegments, and wherein each identifier is created based at least in partupon the fingerprint of the respective content segment.
 2. The method ofclaim 1, wherein the identifier for one of the plurality of contentsegments is the fingerprint for the respective content segment.
 3. Themethod of claim 1, comprising creating a datastore storing the pluralityof identifiers and a plurality of data sets storing one or more dataelements, wherein each identifier of the plurality of identifiers isassociated with one data set of the plurality of data sets, and whereineach of the plurality of identifiers operates as a key to search thedatastore for the data set associated with the respective identifier. 4.The method of claim 3, wherein the one or more data elements comprisethe content segment associated with the respective identifier.
 5. Themethod of claim 3, wherein the one or more data elements comprisemetadata relating to the content segment associated with the respectiveidentifier, metadata relating to the digital content, digital rightsdata of the content segment associated with the respective identifier,playback information data of the content segment associated with therespective identifier, view defined data relating to the content segmentassociated with the respective identifier, or any combination thereof.6. The method of claim 3, comprising associating one identifier of theplurality of identifiers with at least one other identifier of theplurality of identifiers, wherein the association is determined based atleast in part upon a content segment sequencing representation thatdefines a playback order of the content segments.
 7. The method of claim6, wherein the one or more data elements comprise the at least one otheridentifier.
 8. The method of claim 3, wherein the datastore comprises arelational database, a mass storage file system, or a web service.
 9. Amethod of playing back digital content, comprising: determining a firstnode of a content segment sequencing representation, wherein the firstnode is associated with a first identifier that uniquely identifies afirst content segment of a content file, and wherein the firstidentifier is determined based at least in part upon a fingerprint ofthe first content segment, and wherein the content segment sequencingrepresentation defines a playback order of content segments; anddetermining a second node of the content segment sequencingrepresentation, wherein the second node is associated with a secondidentifier that uniquely identifies a second content segment of thecontent file, and wherein the second identifier is determined based atleast in part upon a fingerprint of the second content segment; whereinthe first and second content segments are created by analyzing thecontent file at a determined frame resolution rate.
 10. The method ofclaim 9, comprising constructing the content segment sequencingrepresentation using the first and second nodes, wherein the contentsegment sequencing representation defines the playback order such thatthe first content segment is played back immediately prior to the secondcontent segment.
 11. The method of claim 9, comprising playing back thefirst content segment and the second content segment on a media devicebased on the content segment sequencing representation.
 12. The methodof claim 9, wherein determining the second node comprises retrieving thesecond identifier from a datastore using the first identifier as asearch key, wherein the datatstore stores an association between thefirst identifier and the second identifier.
 13. The method of claim 9,comprising retrieving the first content segment and the second contentsegment from a datastore using the first identifier and the secondidenfitifer, respectively.
 14. The method of claim 9, wherein thecontent segment sequencing representation comprises a content rendergraph.
 15. The method of claim 9, comprising determining a third node ofthe content segment sequencing representation, wherein the third node isassociated with a third identifier that uniquely identifies acoordinated content segment, and wherein the third identifier isdetermined based at least in part upon a fingerprint of the coordinatedcontent segment, and wherein the coordinated content segment is createdby analyzing a coordinated content file at a determined frame resolutionrate.
 16. The method of claim 15, wherein determining the third nodecomprises retrieving the third identifier from a datastore using thefirst identifier as a search key, wherein the datastore stores anassociation between the first identifier and the third identifier. 17.The method of claim 15, wherein determining the third node comprisesreceiving, via a media device, the third identifier from a coordinateddevice.
 18. The method of claim 15, comprising playing back thecoordinated content segment and at least one of the first contentsegment or the second content segment in snyc on a media device based onthe content segment sequencing representation.
 19. The method of claim15, comprising: playing back the first content segment and the secondcontent segment based on the content segment sequencing representation;and playing back the coordinated content segment on a coordinated devicebased on the sequencing representation; and wherein the coordinatedcontent segment is played back in sync with at least one of the firstcontent segment or the second content segment.
 20. A system for playingback digital content, comprising: a media device configured to receivedigital content from one or more content providers, wherein the mediadevice comprises: an identifier reader component configured to read oneor more identifiers from the digital content, wherein each identifier ofthe one or more identifiers uniquely identifies one content segment of aplurality of content segments and is determined based at least in partupon a fingerprint of the respective content segment, and wherein theplurality of content segments is created by: segmenting a content fileinto the plurality of content segments at a determined frame resolutionrate; and associating a corresponding identifier of the one or moreidentifiers to each of the plurality of content segments; and dataprocessing circuitry configured to use the one or more identifiers readby the identifier reader component to construct a content segmentsequencing representation that defines a playback order of the contentsegments.
 21. The system of claim 20, comprising a datastore storing theone or more identifiers and the plurality of content segments, whereineach identifier operates as a key to search the datastore for thecontent segment that is uniquely identified by the respectiveidentifier.
 22. The system of claim 21, wherein the media device isconfigured to retrieve one or more content segments of the plurality ofcontent segments from the datastore using the respective one or moreidentifiers.
 23. The system of claim 21, wherein the datastore isconfigured to store an association between a first identifier of the oneor more identifiers and a second identifier of the one or moreidentifiers.
 24. The system of cicaim 23, wherein the media device isconfigured to retrieve the second identifier from the datastore usingthe first identifier, and wherein data processing circuitry isconfigured construct the content segment sequencing representation usingthe first and the second identifiers.
 25. The system of claim 20,wherein the data processing circuitry is configured to determine acoordinated identifier that uniquely identifies a coordinated contentsegment, wherein the coordinated identifer is based at least in partupon a fingerprint of the coordinated content segment, and wherein thecoordinated content segment is created by analyzing a coordinatedcontent file at a determined frame resolution rate.
 26. The system ofclaim 25, wherein the data processing circuitry is configured toconstruct the content segment sequencing representation such thatdefines the playback order of the content segments such that thecoordinated content segment is played back in sync with at least one ofthe plurality of the content segments.
 27. The system of claim 26,wherein the media device comprises playback circuitry configured to playback one or more of the plurality of content segments and thecoordinated content segment in sync based on the content segmentsequencing representation.
 28. The system of claim 26, comprising acoordinated device comprising playback circuitry configured to play backthe coordinated content segment based on the content segment sequencingrepresentation, and wherein the media device comprises playbackcircuitry configured to playback one or more of the plurality of contentsegments based on the content segment sequencing representation.
 29. Thesystem of claim 25, wherein the data processing circuitry is configuredto retrieve the coordinated identifier from a datastore using at leastone identifier of the one or more identifiers as a search key, whereinthe datastore stores an association between the at least one identifierand the coordinated identifier.